Pandas Profiling Report

Dataset statistics

Number of variables	15
Number of observations	5546880
Missing cells	4147574
Missing cells (%)	5.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	634.8 MiB
Average record size in memory	120.0 B

Variable types

Categorical	2
Numeric	13

Alerts

`DATEUTC` has a high cardinality: 52560 distinct values	High cardinality
`ID` has a high cardinality: 108 distinct values	High cardinality
`LC_HUMIDITY` is highly overall correlated with `LC_RAD` and 5 other fields	High correlation
`LC_DWPTEMP` is highly overall correlated with `LC_TEMP_QCL0` and 3 other fields	High correlation
`LC_RAD` is highly overall correlated with `LC_HUMIDITY` and 1 other fields	High correlation
`LC_RAD60` is highly overall correlated with `LC_HUMIDITY` and 5 other fields	High correlation
`LC_TEMP_QCL0` is highly overall correlated with `LC_HUMIDITY` and 5 other fields	High correlation
`LC_TEMP_QCL1` is highly overall correlated with `LC_HUMIDITY` and 5 other fields	High correlation
`LC_TEMP_QCL2` is highly overall correlated with `LC_HUMIDITY` and 5 other fields	High correlation
`LC_TEMP_QCL3` is highly overall correlated with `LC_HUMIDITY` and 5 other fields	High correlation
`LC_HUMIDITY` has 314899 (5.7%) missing values	Missing
`LC_DWPTEMP` has 314899 (5.7%) missing values	Missing
`LC_n` has 314899 (5.7%) missing values	Missing
`LC_RAD` has 314899 (5.7%) missing values	Missing
`LC_RAININ` has 314899 (5.7%) missing values	Missing
`LC_DAILYRAIN` has 314899 (5.7%) missing values	Missing
`LC_WINDDIR` has 314899 (5.7%) missing values	Missing
`LC_WINDSPEED` has 314899 (5.7%) missing values	Missing
`LC_RAD60` has 277022 (5.0%) missing values	Missing
`LC_TEMP_QCL0` has 314899 (5.7%) missing values	Missing
`LC_TEMP_QCL1` has 345487 (6.2%) missing values	Missing
`LC_TEMP_QCL2` has 345487 (6.2%) missing values	Missing
`LC_TEMP_QCL3` has 345487 (6.2%) missing values	Missing
`LC_RAININ` is highly skewed (γ1 = 46.73704986)	Skewed
`DATEUTC` is uniformly distributed	Uniform
`LC_RAD` has 2610449 (47.1%) zeros	Zeros
`LC_RAININ` has 5068067 (91.4%) zeros	Zeros
`LC_DAILYRAIN` has 4333746 (78.1%) zeros	Zeros
`LC_WINDDIR` has 2022619 (36.5%) zeros	Zeros
`LC_WINDSPEED` has 2122964 (38.3%) zeros	Zeros
`LC_RAD60` has 2542931 (45.8%) zeros	Zeros

Reproduction

Analysis started	2023-04-24 15:04:28.978658
Analysis finished	2023-04-24 15:07:04.641917
Duration	2 minutes and 35.66 seconds
Software version	ydata-profiling vv4.1.2
Download configuration	config.json

DATEUTC
Categorical

HIGH CARDINALITY UNIFORM

Distinct	52560
Distinct (%)	0.9%
Missing	0
Missing (%)	0.0%
Memory size	42.3 MiB

2022-07-02 12:10:00	108
2022-09-01 09:00:00	108
2022-09-01 07:20:00	108
2022-09-01 07:30:00	108
2022-09-01 07:40:00	108
Other values (52555)	5546340

Length

Max length	19
Median length	19
Mean length	19
Min length	19

Characters and Unicode

Total characters	105390720
Distinct characters	13
Distinct categories	4 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	2022-01-01 00:10:00
2nd row	2022-01-01 00:20:00
3rd row	2022-01-01 00:30:00
4th row	2022-01-01 00:40:00
5th row	2022-01-01 00:50:00

Common Values

Value	Count	Frequency (%)
2022-07-02 12:10:00	108	< 0.1%
2022-09-01 09:00:00	108	< 0.1%
2022-09-01 07:20:00	108	< 0.1%
2022-09-01 07:30:00	108	< 0.1%
2022-09-01 07:40:00	108	< 0.1%
2022-09-01 07:50:00	108	< 0.1%
2022-09-01 08:00:00	108	< 0.1%
2022-09-01 08:10:00	108	< 0.1%
2022-09-01 08:20:00	108	< 0.1%
2022-09-01 08:30:00	108	< 0.1%
Other values (52550)	5545800	> 99.9%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
20:50:00	38520	0.3%
23:20:00	38520	0.3%
13:40:00	38520	0.3%
13:50:00	38520	0.3%
14:00:00	38520	0.3%
14:10:00	38520	0.3%
14:20:00	38520	0.3%
14:30:00	38520	0.3%
14:40:00	38520	0.3%
14:50:00	38520	0.3%
Other values (500)	10708560	96.5%

Most occurring characters

Value	Count	Frequency (%)
0	32888304	31.2%
2	22415940	21.3%
-	11093760	10.5%
:	11093760	10.5%
1	8739802	8.3%
	5546880	5.3%
3	2876508	2.7%
5	2415744	2.3%
4	2400182	2.3%
7	1491264	1.4%
Other values (3)	4428576	4.2%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	77656320	73.7%
Dash Punctuation	11093760	10.5%
Other Punctuation	11093760	10.5%
Space Separator	5546880	5.3%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	32888304	42.4%
2	22415940	28.9%
1	8739802	11.3%
3	2876508	3.7%
5	2415744	3.1%
4	2400182	3.1%
7	1491264	1.9%
8	1491264	1.9%
6	1475712	1.9%
9	1461600	1.9%

Dash Punctuation

Value	Count	Frequency (%)
-	11093760	100.0%

Other Punctuation

Value	Count	Frequency (%)
:	11093760	100.0%

Space Separator

Value	Count	Frequency (%)
	5546880	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	105390720	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
0	32888304	31.2%
2	22415940	21.3%
-	11093760	10.5%
:	11093760	10.5%
1	8739802	8.3%
	5546880	5.3%
3	2876508	2.7%
5	2415744	2.3%
4	2400182	2.3%
7	1491264	1.4%
Other values (3)	4428576	4.2%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	105390720	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	32888304	31.2%
2	22415940	21.3%
-	11093760	10.5%
:	11093760	10.5%
1	8739802	8.3%
	5546880	5.3%
3	2876508	2.7%
5	2415744	2.3%
4	2400182	2.3%
7	1491264	1.4%
Other values (3)	4428576	4.2%

ID
Categorical

Distinct	108
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	42.3 MiB

LC-002	52560
LC-104	52560
LC-100	52560
LC-099	52560
LC-097	52560
Other values (103)	5284080

Length

Max length	6
Median length	6
Mean length	6
Min length	6

Characters and Unicode

Total characters	33281280
Distinct characters	13
Distinct categories	3 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	LC-002
2nd row	LC-002
3rd row	LC-002
4th row	LC-002
5th row	LC-002

Common Values

Value	Count	Frequency (%)
LC-002	52560	0.9%
LC-104	52560	0.9%
LC-100	52560	0.9%
LC-099	52560	0.9%
LC-097	52560	0.9%
LC-096	52560	0.9%
LC-095	52560	0.9%
LC-094	52560	0.9%
LC-092	52560	0.9%
LC-091	52560	0.9%
Other values (98)	5021280	90.5%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
lc-002	52560	0.9%
lc-031	52560	0.9%
lc-004	52560	0.9%
lc-005	52560	0.9%
lc-006	52560	0.9%
lc-008	52560	0.9%
lc-009	52560	0.9%
lc-010	52560	0.9%
lc-011	52560	0.9%
lc-012	52560	0.9%
Other values (98)	5021280	90.5%

Most occurring characters

Value	Count	Frequency (%)
L	5546880	16.7%
C	5546880	16.7%
-	5546880	16.7%
0	5085360	15.3%
1	3116160	9.4%
2	1498320	4.5%
3	1184400	3.6%
4	1143360	3.4%
7	985680	3.0%
6	985680	3.0%
Other values (3)	2641680	7.9%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	16640640	50.0%
Uppercase Letter	11093760	33.3%
Dash Punctuation	5546880	16.7%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	5085360	30.6%
1	3116160	18.7%
2	1498320	9.0%
3	1184400	7.1%
4	1143360	6.9%
7	985680	5.9%
6	985680	5.9%
9	933120	5.6%
8	933120	5.6%
5	775440	4.7%

Uppercase Letter

Value	Count	Frequency (%)
L	5546880	50.0%
C	5546880	50.0%

Dash Punctuation

Value	Count	Frequency (%)
-	5546880	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	22187520	66.7%
Latin	11093760	33.3%

Most frequent character per script

Common

Value	Count	Frequency (%)
-	5546880	25.0%
0	5085360	22.9%
1	3116160	14.0%
2	1498320	6.8%
3	1184400	5.3%
4	1143360	5.2%
7	985680	4.4%
6	985680	4.4%
9	933120	4.2%
8	933120	4.2%

Latin

Value	Count	Frequency (%)
L	5546880	50.0%
C	5546880	50.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	33281280	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
L	5546880	16.7%
C	5546880	16.7%
-	5546880	16.7%
0	5085360	15.3%
1	3116160	9.4%
2	1498320	4.5%
3	1184400	3.6%
4	1143360	3.4%
7	985680	3.0%
6	985680	3.0%
Other values (3)	2641680	7.9%

LC_HUMIDITY
Real number (ℝ)

HIGH CORRELATION MISSING

Distinct	88
Distinct (%)	< 0.1%
Missing	314899
Missing (%)	5.7%
Infinite	0
Infinite (%)	0.0%
Mean	76.606512

Minimum	12
Maximum	99
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	42.3 MiB

Quantile statistics

Minimum	12
5-th percentile	41
Q1	64
median	82
Q3	92
95-th percentile	99
Maximum	99
Range	87
Interquartile range (IQR)	28

Descriptive statistics

Standard deviation	18.543738
Coefficient of variation (CV)	0.24206478
Kurtosis	-0.42356597
Mean	76.606512
Median Absolute Deviation (MAD)	12
Skewness	-0.74770265
Sum	4.0080381 × 10⁸
Variance	343.87024
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
99	332470	6.0%
96	160179	2.9%
95	158226	2.9%
94	156788	2.8%
97	153372	2.8%
93	150826	2.7%
92	147876	2.7%
91	141544	2.6%
90	141079	2.5%
98	137983	2.5%
Other values (78)	3551638	64.0%
(Missing)	314899	5.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
12	1	< 0.1%
13	40	< 0.1%
14	223	< 0.1%
15	457	< 0.1%
16	649	< 0.1%
17	656	< 0.1%
18	683	< 0.1%
19	732	< 0.1%
20	1110	< 0.1%
21	1517	< 0.1%

Value	Count	Frequency (%)
99	332470	6.0%
98	137983	2.5%
97	153372	2.8%
96	160179	2.9%
95	158226	2.9%
94	156788	2.8%
93	150826	2.7%
92	147876	2.7%
91	141544	2.6%
90	141079	2.5%

LC_DWPTEMP
Real number (ℝ)

HIGH CORRELATION MISSING

Distinct	3560
Distinct (%)	0.1%
Missing	314899
Missing (%)	5.7%
Infinite	0
Infinite (%)	0.0%
Mean	8.1499152

Minimum	-12.6
Maximum	59.78
Zeros	4444
Zeros (%)	0.1%
Negative	433125
Negative (%)	7.8%
Memory size	42.3 MiB

Quantile statistics

Minimum	-12.6
5-th percentile	-1.44
Q1	4.26
median	8.76
Q3	12.28
95-th percentile	16.27
Maximum	59.78
Range	72.38
Interquartile range (IQR)	8.02

Descriptive statistics

Standard deviation	5.4557662
Coefficient of variation (CV)	0.66942613
Kurtosis	-0.37837472
Mean	8.1499152
Median Absolute Deviation (MAD)	3.96
Skewness	-0.37391665
Sum	42640201
Variance	29.765385
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
9.39	9754	0.2%
8.89	9611	0.2%
9.28	9371	0.2%
9.22	9258	0.2%
9.11	9239	0.2%
9.5	9168	0.2%
9.61	9112	0.2%
6.61	8691	0.2%
9.78	8648	0.2%
9.72	8647	0.2%
Other values (3550)	5140482	92.7%
(Missing)	314899	5.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-12.6	3	< 0.1%
-12.5	2	< 0.1%
-12.4	1	< 0.1%
-12.39	1	< 0.1%
-12.34	1	< 0.1%
-12.33	2	< 0.1%
-12.3	2	< 0.1%
-12.29	1	< 0.1%
-12.28	2	< 0.1%
-12.25	2	< 0.1%

Value	Count	Frequency (%)
59.78	10	< 0.1%
59.32	1	< 0.1%
59.05	1	< 0.1%
58.72	2	< 0.1%
41.61	1	< 0.1%
41.56	1	< 0.1%
34.39	1	< 0.1%
32.36	1	< 0.1%
30.23	1	< 0.1%
29.16	1	< 0.1%

LC_n
Real number (ℝ)

Distinct	47
Distinct (%)	< 0.1%
Missing	314899
Missing (%)	5.7%
Infinite	0
Infinite (%)	0.0%
Mean	35.381164

Minimum	1
Maximum	47
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	42.3 MiB

Quantile statistics

Minimum	1
5-th percentile	17
Q1	37
median	37
Q3	38
95-th percentile	38
Maximum	47
Range	46
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	6.6904014
Coefficient of variation (CV)	0.18909501
Kurtosis	12.765319
Mean	35.381164
Median Absolute Deviation (MAD)	1
Skewness	-3.6654634
Sum	1.8511358 × 10⁸
Variance	44.761471
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=47)

Value	Count	Frequency (%)
37	2148882	38.7%
38	2133692	38.5%
35	168968	3.0%
32	152968	2.8%
36	152725	2.8%
31	74293	1.3%
10	19945	0.4%
30	19039	0.3%
3	18727	0.3%
8	18494	0.3%
Other values (37)	324248	5.8%
(Missing)	314899	5.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	11336	0.2%
2	18208	0.3%
3	18727	0.3%
4	17387	0.3%
5	17305	0.3%
6	16371	0.3%
7	16408	0.3%
8	18494	0.3%
9	16379	0.3%
10	19945	0.4%

Value	Count	Frequency (%)
47	4	< 0.1%
46	1	< 0.1%
45	7	< 0.1%
44	11	< 0.1%
43	15	< 0.1%
42	22	< 0.1%
41	28	< 0.1%
40	38	< 0.1%
39	3399	0.1%
38	2133692	38.5%

LC_RAD
Real number (ℝ)

HIGH CORRELATION MISSING ZEROS

Distinct	926
Distinct (%)	< 0.1%
Missing	314899
Missing (%)	5.7%
Infinite	0
Infinite (%)	0.0%
Mean	79.722921

Minimum	0
Maximum	1017
Zeros	2610449
Zeros (%)	47.1%
Negative	0
Negative (%)	0.0%
Memory size	42.3 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	1
Q3	85
95-th percentile	447
Maximum	1017
Range	1017
Interquartile range (IQR)	85

Descriptive statistics

Standard deviation	144.51869
Coefficient of variation (CV)	1.8127621
Kurtosis	4.1749581
Mean	79.722921
Median Absolute Deviation (MAD)	1
Skewness	2.198542
Sum	4.1710881 × 10⁸
Variance	20885.651
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	2610449	47.1%
1	44743	0.8%
4	37411	0.7%
3	33443	0.6%
2	31940	0.6%
5	27484	0.5%
6	22004	0.4%
7	20077	0.4%
23	19410	0.3%
22	19381	0.3%
Other values (916)	2365639	42.6%
(Missing)	314899	5.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	2610449	47.1%
1	44743	0.8%
2	31940	0.6%
3	33443	0.6%
4	37411	0.7%
5	27484	0.5%
6	22004	0.4%
7	20077	0.4%
8	18710	0.3%
9	17207	0.3%

Value	Count	Frequency (%)
1017	1	< 0.1%
994	1	< 0.1%
975	1	< 0.1%
959	1	< 0.1%
956	1	< 0.1%
954	1	< 0.1%
950	2	< 0.1%
949	1	< 0.1%
948	2	< 0.1%
946	1	< 0.1%

LC_RAININ
Real number (ℝ)

MISSING SKEWED ZEROS

Distinct	110
Distinct (%)	< 0.1%
Missing	314899
Missing (%)	5.7%
Infinite	0
Infinite (%)	0.0%
Mean	0.00010391016

Minimum	0
Maximum	0.38
Zeros	5068067
Zeros (%)	91.4%
Negative	0
Negative (%)	0.0%
Memory size	42.3 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	0
Maximum	0.38
Range	0.38
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.0010074327
Coefficient of variation (CV)	9.6952279
Kurtosis	8050.1865
Mean	0.00010391016
Median Absolute Deviation (MAD)	0
Skewness	46.73705
Sum	543.656
Variance	1.0149207 × 10^-6
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	5068067	91.4%
0.002	52715	1.0%
0.001	45753	0.8%
0.003	26337	0.5%
0.004	11488	0.2%
0.005	6790	0.1%
0.006	5099	0.1%
0.007	3265	0.1%
0.008	2432	< 0.1%
0.009	1681	< 0.1%
Other values (100)	8354	0.2%
(Missing)	314899	5.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	5068067	91.4%
0.001	45753	0.8%
0.002	52715	1.0%
0.003	26337	0.5%
0.004	11488	0.2%
0.005	6790	0.1%
0.006	5099	0.1%
0.007	3265	0.1%
0.008	2432	< 0.1%
0.009	1681	< 0.1%

Value	Count	Frequency (%)
0.38	1	< 0.1%
0.335	1	< 0.1%
0.167	1	< 0.1%
0.141	2	< 0.1%
0.129	1	< 0.1%
0.123	2	< 0.1%
0.114	1	< 0.1%
0.111	1	< 0.1%
0.11	1	< 0.1%
0.109	1	< 0.1%

LC_DAILYRAIN
Real number (ℝ)

MISSING ZEROS

Distinct	144
Distinct (%)	< 0.1%
Missing	314899
Missing (%)	5.7%
Infinite	0
Infinite (%)	0.0%
Mean	0.0012207363

Minimum	0
Maximum	0.154
Zeros	4333746
Zeros (%)	78.1%
Negative	0
Negative (%)	0.0%
Memory size	42.3 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0
95-th percentile	0.007
Maximum	0.154
Range	0.154
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	0.0051048583
Coefficient of variation (CV)	4.1817864
Kurtosis	337.27104
Mean	0.0012207363
Median Absolute Deviation (MAD)	0
Skewness	14.203188
Sum	6386.869
Variance	2.6059579 × 10^-5
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	4333746	78.1%
0.002	181737	3.3%
0.001	118642	2.1%
0.003	81847	1.5%
0.004	80846	1.5%
0.007	72514	1.3%
0.005	60622	1.1%
0.006	54105	1.0%
0.008	36966	0.7%
0.009	28636	0.5%
Other values (134)	182320	3.3%
(Missing)	314899	5.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	4333746	78.1%
0.001	118642	2.1%
0.002	181737	3.3%
0.003	81847	1.5%
0.004	80846	1.5%
0.005	60622	1.1%
0.006	54105	1.0%
0.007	72514	1.3%
0.008	36966	0.7%
0.009	28636	0.5%

Value	Count	Frequency (%)
0.154	7	< 0.1%
0.153	14	< 0.1%
0.152	97	< 0.1%
0.151	789	< 0.1%
0.15	116	< 0.1%
0.149	15	< 0.1%
0.148	10	< 0.1%
0.147	5	< 0.1%
0.146	13	< 0.1%
0.145	9	< 0.1%

LC_WINDDIR
Real number (ℝ)

MISSING ZEROS

Distinct	360
Distinct (%)	< 0.1%
Missing	314899
Missing (%)	5.7%
Infinite	0
Infinite (%)	0.0%
Mean	-5.7257561

Minimum	-179
Maximum	180
Zeros	2022619
Zeros (%)	36.5%
Negative	1714369
Negative (%)	30.9%
Memory size	42.3 MiB

Quantile statistics

Minimum	-179
5-th percentile	-158
Q1	-56
median	0
Q3	28
95-th percentile	154
Maximum	180
Range	359
Interquartile range (IQR)	84

Descriptive statistics

Standard deviation	87.312361
Coefficient of variation (CV)	-15.249054
Kurtosis	-0.34460102
Mean	-5.7257561
Median Absolute Deviation (MAD)	41
Skewness	0.026313425
Sum	-29957047
Variance	7623.4484
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	2022619	36.5%
-146	13778	0.2%
-147	13770	0.2%
-144	13767	0.2%
-145	13690	0.2%
-143	13621	0.2%
-148	13606	0.2%
-149	13440	0.2%
-142	13402	0.2%
-140	13355	0.2%
Other values (350)	3086933	55.7%
(Missing)	314899	5.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-179	10578	0.2%
-178	10785	0.2%
-177	11081	0.2%
-176	10955	0.2%
-175	11332	0.2%
-174	11363	0.2%
-173	11644	0.2%
-172	11870	0.2%
-171	11991	0.2%
-170	12096	0.2%

Value	Count	Frequency (%)
180	10609	0.2%
179	10390	0.2%
178	10234	0.2%
177	10109	0.2%
176	9867	0.2%
175	9803	0.2%
174	9685	0.2%
173	9745	0.2%
172	9771	0.2%
171	9676	0.2%

LC_WINDSPEED
Real number (ℝ)

MISSING ZEROS

Distinct	892
Distinct (%)	< 0.1%
Missing	314899
Missing (%)	5.7%
Infinite	0
Infinite (%)	0.0%
Mean	0.28557705

Minimum	0
Maximum	13.7
Zeros	2122964
Zeros (%)	38.3%
Negative	0
Negative (%)	0.0%
Memory size	42.3 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0.04
Q3	0.31
95-th percentile	1.4
Maximum	13.7
Range	13.7
Interquartile range (IQR)	0.31

Descriptive statistics

Standard deviation	0.56429441
Coefficient of variation (CV)	1.9759795
Kurtosis	20.145078
Mean	0.28557705
Median Absolute Deviation (MAD)	0.04
Skewness	3.7023949
Sum	1494133.7
Variance	0.31842819
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	2122964	38.3%
0.01	186275	3.4%
0.02	153706	2.8%
0.03	122616	2.2%
0.04	105635	1.9%
0.05	93342	1.7%
0.06	84198	1.5%
0.07	76651	1.4%
0.08	70054	1.3%
0.09	65109	1.2%
Other values (882)	2151431	38.8%
(Missing)	314899	5.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	2122964	38.3%
0.01	186275	3.4%
0.02	153706	2.8%
0.03	122616	2.2%
0.04	105635	1.9%
0.05	93342	1.7%
0.06	84198	1.5%
0.07	76651	1.4%
0.08	70054	1.3%
0.09	65109	1.2%

Value	Count	Frequency (%)
13.7	1	< 0.1%
12.2	1	< 0.1%
12.15	1	< 0.1%
11.44	1	< 0.1%
11.21	1	< 0.1%
11.2	1	< 0.1%
10.71	1	< 0.1%
10.62	1	< 0.1%
10.45	1	< 0.1%
10.42	1	< 0.1%

LC_RAD60
Real number (ℝ)

HIGH CORRELATION MISSING ZEROS

Distinct	868
Distinct (%)	< 0.1%
Missing	277022
Missing (%)	5.0%
Infinite	0
Infinite (%)	0.0%
Mean	79.6632

Minimum	0
Maximum	914
Zeros	2542931
Zeros (%)	45.8%
Negative	0
Negative (%)	0.0%
Memory size	42.3 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	2
Q3	88
95-th percentile	435
Maximum	914
Range	914
Interquartile range (IQR)	88

Descriptive statistics

Standard deviation	141.71334
Coefficient of variation (CV)	1.7789059
Kurtosis	3.8493839
Mean	79.6632
Median Absolute Deviation (MAD)	2
Skewness	2.1298608
Sum	4.1981375 × 10⁸
Variance	20082.67
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	2542931	45.8%
1	82486	1.5%
2	49595	0.9%
3	41647	0.8%
4	39827	0.7%
5	26770	0.5%
6	22505	0.4%
7	20735	0.4%
8	18928	0.3%
27	18481	0.3%
Other values (858)	2405953	43.4%
(Missing)	277022	5.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	2542931	45.8%
1	82486	1.5%
2	49595	0.9%
3	41647	0.8%
4	39827	0.7%
5	26770	0.5%
6	22505	0.4%
7	20735	0.4%
8	18928	0.3%
9	18414	0.3%

Value	Count	Frequency (%)
914	1	< 0.1%
900	1	< 0.1%
896	1	< 0.1%
894	1	< 0.1%
884	1	< 0.1%
882	2	< 0.1%
878	1	< 0.1%
876	1	< 0.1%
873	1	< 0.1%
870	1	< 0.1%

LC_TEMP_QCL0
Real number (ℝ)

HIGH CORRELATION MISSING

Distinct	5349
Distinct (%)	0.1%
Missing	314899
Missing (%)	5.7%
Infinite	0
Infinite (%)	0.0%
Mean	12.777789

Minimum	-11.7
Maximum	60
Zeros	7227
Zeros (%)	0.1%
Negative	175303
Negative (%)	3.2%
Memory size	42.3 MiB

Quantile statistics

Minimum	-11.7
5-th percentile	1
Q1	7.38
median	12.39
Q3	17.89
95-th percentile	25.77
Maximum	60
Range	71.7
Interquartile range (IQR)	10.51

Descriptive statistics

Standard deviation	7.6258419
Coefficient of variation (CV)	0.59680448
Kurtosis	-0.15275933
Mean	12.777789
Median Absolute Deviation (MAD)	5.28
Skewness	0.20711242
Sum	66853152
Variance	58.153465
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
9.89	11822	0.2%
9.78	11787	0.2%
10	11707	0.2%
10.5	11097	0.2%
9.72	11073	0.2%
10.11	10755	0.2%
10.28	10739	0.2%
10.22	10696	0.2%
8.28	10695	0.2%
9.61	10655	0.2%
Other values (5339)	5120955	92.3%
(Missing)	314899	5.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-11.7	3	< 0.1%
-11.66	2	< 0.1%
-11.61	3	< 0.1%
-11.6	2	< 0.1%
-11.56	1	< 0.1%
-11.55	1	< 0.1%
-11.54	1	< 0.1%
-11.5	4	< 0.1%
-11.47	1	< 0.1%
-11.45	2	< 0.1%

Value	Count	Frequency (%)
60	10	< 0.1%
59.5	1	< 0.1%
59.28	1	< 0.1%
58.89	2	< 0.1%
43.76	1	< 0.1%
43.71	1	< 0.1%
43.53	1	< 0.1%
43.5	2	< 0.1%
43.49	1	< 0.1%
43.44	1	< 0.1%

LC_TEMP_QCL1
Real number (ℝ)

HIGH CORRELATION MISSING

Distinct	5326
Distinct (%)	0.1%
Missing	345487
Missing (%)	6.2%
Infinite	0
Infinite (%)	0.0%
Mean	12.76951

Minimum	-11.7
Maximum	43.11
Zeros	7132
Zeros (%)	0.1%
Negative	174851
Negative (%)	3.2%
Memory size	42.3 MiB

Quantile statistics

Minimum	-11.7
5-th percentile	1
Q1	7.37
median	12.39
Q3	17.89
95-th percentile	25.75
Maximum	43.11
Range	54.81
Interquartile range (IQR)	10.52

Descriptive statistics

Standard deviation	7.6205306
Coefficient of variation (CV)	0.59677551
Kurtosis	-0.15715431
Mean	12.76951
Median Absolute Deviation (MAD)	5.28
Skewness	0.20437188
Sum	66419238
Variance	58.072487
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
9.89	11756	0.2%
9.78	11678	0.2%
10	11612	0.2%
10.5	11029	0.2%
9.72	11006	0.2%
10.28	10660	0.2%
10.11	10659	0.2%
8.28	10633	0.2%
10.22	10626	0.2%
9.61	10570	0.2%
Other values (5316)	5091164	91.8%
(Missing)	345487	6.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-11.7	3	< 0.1%
-11.66	2	< 0.1%
-11.61	3	< 0.1%
-11.6	2	< 0.1%
-11.56	1	< 0.1%
-11.55	1	< 0.1%
-11.54	1	< 0.1%
-11.5	4	< 0.1%
-11.47	1	< 0.1%
-11.45	2	< 0.1%

Value	Count	Frequency (%)
43.11	1	< 0.1%
42.94	1	< 0.1%
42.87	1	< 0.1%
42.83	1	< 0.1%
42.69	1	< 0.1%
42.62	1	< 0.1%
42.51	1	< 0.1%
42.48	1	< 0.1%
42.44	1	< 0.1%
42.43	1	< 0.1%

LC_TEMP_QCL2
Real number (ℝ)

HIGH CORRELATION MISSING

Distinct	92170
Distinct (%)	1.8%
Missing	345487
Missing (%)	6.2%
Infinite	0
Infinite (%)	0.0%
Mean	12.771063

Minimum	-11.7
Maximum	43.197
Zeros	67
Zeros (%)	< 0.1%
Negative	177664
Negative (%)	3.2%
Memory size	42.3 MiB

Quantile statistics

Minimum	-11.7
5-th percentile	0.9925
Q1	7.37
median	12.4
Q3	17.89
95-th percentile	25.761
Maximum	43.197
Range	54.897
Interquartile range (IQR)	10.52

Descriptive statistics

Standard deviation	7.6199829
Coefficient of variation (CV)	0.59666001
Kurtosis	-0.15828887
Mean	12.771063
Median Absolute Deviation (MAD)	5.276
Skewness	0.20587398
Sum	66427320
Variance	58.064139
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
10.8	1748	< 0.1%
10.3	1719	< 0.1%
10.1	1719	< 0.1%
11.8	1648	< 0.1%
13.3	1627	< 0.1%
10.2	1608	< 0.1%
10.7	1544	< 0.1%
13.2	1499	< 0.1%
11.1	1467	< 0.1%
11.3	1464	< 0.1%
Other values (92160)	5185350	93.5%
(Missing)	345487	6.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-11.7	2	< 0.1%
-11.6	1	< 0.1%
-11.5	2	< 0.1%
-11.4655	1	< 0.1%
-11.4345	2	< 0.1%
-11.4	2	< 0.1%
-11.3845	3	< 0.1%
-11.3555	1	< 0.1%
-11.3245	1	< 0.1%
-11.3145	1	< 0.1%

Value	Count	Frequency (%)
43.197	1	< 0.1%
43.027	1	< 0.1%
42.929	1	< 0.1%
42.917	1	< 0.1%
42.749	1	< 0.1%
42.707	1	< 0.1%
42.542	1	< 0.1%
42.539	2	< 0.1%
42.522	1	< 0.1%
42.519	1	< 0.1%

LC_TEMP_QCL3
Real number (ℝ)

HIGH CORRELATION MISSING

Distinct	4567782
Distinct (%)	87.8%
Missing	345487
Missing (%)	6.2%
Infinite	0
Infinite (%)	0.0%
Mean	12.606175

Minimum	-11.4
Maximum	42.161164
Zeros	0
Zeros (%)	0.0%
Negative	177244
Negative (%)	3.2%
Memory size	42.3 MiB

Quantile statistics

Minimum	-11.4
5-th percentile	1.0325705
Q1	7.387517
median	12.349102
Q3	17.66019
95-th percentile	25.004656
Maximum	42.161164
Range	53.561164
Interquartile range (IQR)	10.272673

Descriptive statistics

Standard deviation	7.3911548
Coefficient of variation (CV)	0.58631224
Kurtosis	-0.18548579
Mean	12.606175
Median Absolute Deviation (MAD)	5.1488284
Skewness	0.1501703
Sum	65569671
Variance	54.62917
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
10.8	1400	< 0.1%
10.2	1360	< 0.1%
11.9	1335	< 0.1%
10.3	1334	< 0.1%
10.9	1333	< 0.1%
13.3	1333	< 0.1%
13.4	1310	< 0.1%
11.3	1288	< 0.1%
13.6	1282	< 0.1%
10.1	1281	< 0.1%
Other values (4567772)	5188137	93.5%
(Missing)	345487	6.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-11.4	3	< 0.1%
-11.3	2	< 0.1%
-11.2	1	< 0.1%
-11.18447	1	< 0.1%
-11.17442	2	< 0.1%
-11.12442	1	< 0.1%
-11.1	1	< 0.1%
-11.09022	2	< 0.1%
-11.07447	1	< 0.1%
-11.05952	1	< 0.1%

Value	Count	Frequency (%)
42.16116354	1	< 0.1%
42.12416033	1	< 0.1%
42.02266235	1	< 0.1%
41.95165925	1	< 0.1%
41.93676939	1	< 0.1%
41.85961032	1	< 0.1%
41.83010052	1	< 0.1%
41.70123848	1	< 0.1%
41.36824861	1	< 0.1%
41.23725765	1	< 0.1%

Auto

Heatmap
Table

	LC_HUMIDITY	LC_DWPTEMP	LC_n	LC_RAD	LC_RAININ	LC_DAILYRAIN	LC_WINDDIR	LC_WINDSPEED	LC_RAD60	LC_TEMP_QCL0	LC_TEMP_QCL1	LC_TEMP_QCL2	LC_TEMP_QCL3
LC_HUMIDITY	1.000	-0.169	0.015	-0.553	0.178	0.262	-0.048	-0.292	-0.608	-0.641	-0.641	-0.638	-0.625
LC_DWPTEMP	-0.169	1.000	-0.005	0.225	0.043	0.079	-0.027	-0.008	0.241	0.830	0.830	0.831	0.840
LC_n	0.015	-0.005	1.000	-0.010	0.001	-0.006	-0.004	-0.017	-0.010	-0.009	-0.009	-0.008	-0.008
LC_RAD	-0.553	0.225	-0.010	1.000	-0.053	-0.052	-0.001	0.348	0.954	0.495	0.495	0.494	0.482
LC_RAININ	0.178	0.043	0.001	-0.053	1.000	0.360	-0.020	0.061	-0.048	-0.048	-0.048	-0.048	-0.046
LC_DAILYRAIN	0.262	0.079	-0.006	-0.052	0.360	1.000	-0.066	0.135	-0.035	-0.072	-0.072	-0.071	-0.068
LC_WINDDIR	-0.048	-0.027	-0.004	-0.001	-0.020	-0.066	1.000	-0.092	-0.001	0.014	0.014	0.014	0.012
LC_WINDSPEED	-0.292	-0.008	-0.017	0.348	0.061	0.135	-0.092	1.000	0.354	0.141	0.142	0.140	0.136
LC_RAD60	-0.608	0.241	-0.010	0.954	-0.048	-0.035	-0.001	0.354	1.000	0.537	0.537	0.537	0.522
LC_TEMP_QCL0	-0.641	0.830	-0.009	0.495	-0.048	-0.072	0.014	0.141	0.537	1.000	1.000	1.000	0.999
LC_TEMP_QCL1	-0.641	0.830	-0.009	0.495	-0.048	-0.072	0.014	0.142	0.537	1.000	1.000	1.000	0.999
LC_TEMP_QCL2	-0.638	0.831	-0.008	0.494	-0.048	-0.071	0.014	0.140	0.537	1.000	1.000	1.000	0.999
LC_TEMP_QCL3	-0.625	0.840	-0.008	0.482	-0.046	-0.068	0.012	0.136	0.522	0.999	0.999	0.999	1.000

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

First rows
Last rows

	DATEUTC	ID	LC_HUMIDITY	LC_DWPTEMP	LC_n	LC_WINDDIR	LC_WINDSPEED	LC_TEMP_QCL0	LC_TEMP_QCL1	LC_TEMP_QCL2	LC_TEMP_QCL3
0	2022-01-01 00:10:00	LC-002	92.0	11.78	38.0	-169.0	0.43	13.11	13.11	13.0515	13.048027
1	2022-01-01 00:20:00	LC-002	92.0	11.73	37.0	-170.0	0.33	13.01	13.01	12.9515	12.985849
2	2022-01-01 00:30:00	LC-002	92.0	11.73	38.0	-167.0	0.46	13.00	13.00	12.9415	12.950322
3	2022-01-01 00:40:00	LC-002	92.0	11.72	37.0	-160.0	0.52	13.00	13.00	12.9415	12.949550
4	2022-01-01 00:50:00	LC-002	92.0	11.72	38.0	-166.0	0.51	13.00	13.00	12.9415	12.952268
5	2022-01-01 01:00:00	LC-002	92.0	11.72	37.0	-158.0	0.93	13.00	13.00	12.9415	12.938731
6	2022-01-01 01:10:00	LC-002	92.0	11.71	38.0	-161.0	0.54	13.00	13.00	12.9415	12.949960
7	2022-01-01 01:20:00	LC-002	91.0	11.62	37.0	-163.0	0.71	13.00	13.00	12.9415	12.960576
8	2022-01-01 01:30:00	LC-002	91.0	11.61	38.0	-160.0	0.54	13.00	13.00	12.9415	12.980432
9	2022-01-01 01:40:00	LC-002	91.0	11.61	37.0	-163.0	0.85	13.00	13.00	12.9415	12.963181

	DATEUTC	ID	LC_HUMIDITY	LC_DWPTEMP	LC_n	LC_DAILYRAIN	LC_WINDDIR	LC_WINDSPEED	LC_TEMP_QCL0	LC_TEMP_QCL1	LC_TEMP_QCL2	LC_TEMP_QCL3
5546870	2022-12-31 22:30:00	LC-138	53.0	6.49	32.0	0.002	-70.0	1.45	16.20	16.20	16.45	16.39359
5546871	2022-12-31 22:40:00	LC-138	52.0	6.32	31.0	0.002	-52.0	1.23	16.29	16.29	16.54	16.48690
5546872	2022-12-31 22:50:00	LC-138	51.0	6.30	32.0	0.002	-64.0	1.04	16.43	16.43	16.68	16.63222
5546873	2022-12-31 23:00:00	LC-138	50.0	6.21	31.0	0.002	-61.0	1.43	16.50	16.50	16.75	16.71759
5546874	2022-12-31 23:10:00	LC-138	50.0	6.16	32.0	0.002	-62.0	1.37	16.56	16.56	16.81	16.77703
5546875	2022-12-31 23:20:00	LC-138	50.0	6.05	32.0	0.000	-49.0	0.67	16.51	16.51	16.76	16.76285
5546876	2022-12-31 23:30:00	LC-138	50.0	6.00	32.0	0.000	-65.0	1.39	16.48	16.48	16.73	16.70722
5546877	2022-12-31 23:40:00	LC-138	50.0	5.90	31.0	0.000	-41.0	1.25	16.37	16.37	16.62	16.60001
5546878	2022-12-31 23:50:00	LC-138	50.0	5.89	32.0	0.000	-51.0	1.22	16.27	16.27	16.52	16.50053
5546879	2023-01-01 00:00:00	LC-138	50.0	5.78	31.0	0.000	-53.0	1.08	16.18	16.18	16.43	16.37461

Overview

Variables

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Dash Punctuation

Other Punctuation

Space Separator

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Uppercase Letter

Dash Punctuation

Most occurring scripts

Most frequent character per script

Common

Latin

Most occurring blocks

Most frequent character per block

ASCII

Interactions

Correlations

Missing values

Sample